A robust multi-batch L-BFGS method for machine learning
نویسندگان
چکیده
منابع مشابه
A Robust Multi-Batch L-BFGS Method for Machine Learning
This paper describes an implementation of the L-BFGS method designed to deal with two adversarial situations. The first occurs in distributed computing environments where some of the computational nodes devoted to the evaluation of the function and gradient are unable to return results on time. A similar challenge occurs in a multi-batch approach in which the data points used to compute functio...
متن کاملA Multi-Batch L-BFGS Method for Machine Learning
The question of how to parallelize the stochastic gradient descent (SGD) method has received much attention in the literature. In this paper, we focus instead on batch methods that use a sizeable fraction of the training set at each iteration to facilitate parallelism, and that employ second-order information. In order to improve the learning process, we follow a multi-batch approach in which t...
متن کاملA Progressive Batching L-BFGS Method for Machine Learning
The standard L-BFGS method relies on gradient approximations that are not dominated by noise, so that search directions are descent directions, the line search is reliable, and quasi-Newton updating yields useful quadratic models of the objective function. All of this appears to call for a full batch approach, but since small batch sizes give rise to faster algorithms with better generalization...
متن کاملA Hybrid Machine Learning Method for Intrusion Detection
Data security is an important area of concern for every computer system owner. An intrusion detection system is a device or software application that monitors a network or systems for malicious activity or policy violations. Already various techniques of artificial intelligence have been used for intrusion detection. The main challenge in this area is the running speed of the available implemen...
متن کاملA Robust FACTS Damping Controller Design to Mitigate Interarea Oscillations in a Multi-machine Power System
In this paper, damping of interarea oscillations using simultaneous coordination of static Var compensator (SVC) and power system stabilizer (PSS) is considered. To be effective in damping of oscillations, the best-input signal of power oscillation damper (POD) associated with SVC is selected using Hankel singular values (HSVs), and right-hand plane zeros (RHP-zeros). The 4-machine-2 area...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Optimization Methods and Software
سال: 2019
ISSN: 1055-6788,1029-4937
DOI: 10.1080/10556788.2019.1658107